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Abstract 


A  maximum  likelihood  estimate  (MLE)  is  derived  for  the  failure 
rate  as  a  function  of  age  based  on  incomplete  data,  assuming  the 
failure  rate  function  is  initially  decreasing  and  subsequently  in¬ 
creasing,  with  the  turning  point  unknown.  An  algorithm  for  computa¬ 
tion  of  the  MLE  is  developed;  a  small  worked  example  is  included  to 
show  in  detail  the  steps  of  the  algorithm.  A  program  for  machine 
computation  is  presented.  The  MLE  is  shown  to  be  a  consistent  estima¬ 
tor. 

No  further  assumption  is  required  as  to  the  mathematical  form  of 
the  life-length  distribution  (such  as  exponential,  Wiebull,  normal, 
etc.).  Thus  the  model  may  be  realistically  applied  in  a  variety  of 
reliability  situations,  where  the  so-called  "bathtub  shaped"  failure 
rate  is  appropriate.  In  the  present  paper  it  is  applied  to  the  analysi 
of  airplane  part  failure  data.  A  real  life  large-scale  example  is  pre¬ 
sented  in  which  the  failure  rate  of  a  constant  speed  drive  unit  of  a 
jet  airplane  is  estimated. 


Maximum  Likelihood  Estimation 


of  a  U-Shaped  Failure  Hate  Function 


1.  Introduction 

An  important  problem  in  reliability  analysis  is  to  estimate  failure 
rate  as  a  function  of  age  from  a  set  of  observed  failure  times.  Given  a 
failure  distribution  F  with  density  f,  we  define  the  failure  rate  at 
any  time  t  for  which  F(t)  4  1  by 

(1)  r(t)  =  f(t)/F(t), 

where  F(t)  l-F(t).  A  knowledge  of  the  failure  rate  function  of 
components  of  a  system  is  desirable  in  predicting  system  reliability, 
setting  up  spare  part  kits,  developing  optimal  maintenance  policies, 
constructing  sound  warranty  policies,  and  determining  "burn-in"  periods 
for  components  subject  to  "infant  mortality". 

In  developing  an  estimator  of  the  failure  rate  function  it  is,  of 
course,  desirable  to  use  as  much  a  priori  information  as  is  available 
concerning  the  form  of  the  distribution  or  its  failure  rate.  For  example, 
from  physical  or  engineering  considerations  it  may  be  known  that  any  or 
all  of  the  following  phenomena  may  occur: 

(1)  The  item  may  be  subject  to  infant  mortality;  in  this  case 
the  failure  rate  is  initially  high  and  decreases  during  the  infant 
mortality  phase.  This  might  correspond  to  the  presence  of  defective 
units  in  the  population  which  fail  early. 
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(2)  Following  r lie  Infant  mortality  phase  (if  it  exists),  for 

a  relatively  long  period  the  item  is  subject  only  to  chance  failures 
(perhaps  as  a  result  of  randomly  occurring  environmental  stresses) 
and  thus  displays  a  constant  failure  rate.  This  period  is  known  as 

the  useful  life  phase. 

(3)  Finally  the  wearout  phase  commences;  the  item  now  displays  a 
failure  rate  increasing  witli  age,  ref lect ing  its  increasing  vulnerability  to 
failure.  This  may  be  the  result  of  actual  wearing  down  of  material  in  the 
unit  (e.g.,  the  rubber  in  a  tire),  of  drift  of  important  parameters  from 
their  nominal  values  (e.g.,  electrical  characteristics  of  a  tube),  of 
deterioration  in  the  functioning  of  components  (e.g.,  human  organs),  etc. 

Airplane  operating  data  represents  a  good  example  of  a  case  in 
which  for  most  parts  some  or  all  of  the  three  phases  of  the  failure  rate 
function  are  present,  but  it  is  not  known  in  advance  which  phases  (if  any) 
are  absent. 

In  this  paper  we  develop  the  maximum  likelihood  estimator  (MLE) 
for  the  failure  rate  function  assuming  that  the  failure  rate  is 
initially  decreasing  and  then  increasing;  we  call  this  a  U-shaped 
failure  rate  function.  Note  that  failure  rate  functions  possessing 
one  or  more  of  the  three  phases  described  above  are  initially  decreasing 
and  then  increasing  (neither  term  is  used  in  the  strict  sense  in  this 
paper)  ,  so  that  if  we  use  the  method  developed  in  this  paper  we  obtain 
an  MLE  in  each  case,  assuming,  of  course,  that  we  do  not  definitely 
know  a  priori  that  any  given  phase  is  not  present.  A  program  for 
machine  calculation  of  the  MLE  has  been  developed  and  is  presented  in 
Section  6.  A  small-scale,  simplified  problem  is  solved  to  show  in 


detail  the  successive  steps  involved  (Section  3).  Mathematical  deri¬ 
vation  of  the  MLE  is  presented  in  Section  A.  Consistency  of  the  MLE 
is  demonstrated  in  Section  5.  The  present  paper  is  an  expansion  of 
Bray-Crawford-Proschan  (1967). 

One  advantage  of  the  method  presented  for  estimating  the  failure 
rate  function  is  that  it  is  not  necessary  to  make  a  strong,  non-verifiable 
assumption  that  the  form  of  the  distribution  is  exponential,  Weibull, 
gamma,  normal,  etc. 


2,  The  Maximum  Likelihood  Estimate  of  the  Failure  Rate  Function 

Assume  that  each  of  n  units  is  observed  over  some  or  all  of  its 
life.  Thus  unit  i  is  observed  from  age  0  until  it  either  fails 

at  a  random  age  >_  a ^  or  has  attained  age  b^  a^,  whichever  occurs 
first  (i=l,...,n).  We  now  give  a  procedure  for  obtaining  a  MLE  of  the 
failure  rate  r(t),  assuming  that  r  is  decreasing  on  [ 0 , t^]  and 
increasing  on  (t^,00),  where  tg(0  £  tg  <_  °°)  is  unknown.  To  avoid 

complications,  we  do  not  consider  the  case  in  which  a  failure  accurs  at 

7 

age  0.  Note  that  t^  =  0  corresponds  to  the  case  of  increasing  failure 
rate  (IFR),  while  t^  =  00  corresponds  to  the  case  of  decreasing  failure 
rate  (DFR) .  In  reading  the  steps  of  the  procedure,  it  is  helpful 
to  see  how  they  are  applied  in  the  example  of  Section  3. 

Procedure  for  Obtaining  the  MLE 

(1)  Suppose  k  (1  <  k  <  n)  failures  are  actually  observed.  Let 
X1  — * **—  \  denote  t*ie  ordered  ages  at  failure;  for  convenience, 

define  Xq  =  0,  =  maxlb^, . .  •  ,bR,Y^ , . . .  ,Yn)  (i.e.,  the  oldest  age 

observed).  Let  Ti  denote  the  total  time  observed  during  (Xj_^,X^) 


for  i-1, 2, . . .  ,k+l;  will  be  referred  to  as  the  "exposure  time" 

during  the  i*"^  Interval. 

(2)  We  obtain  the  MLE  fj(t)  for  t^ie  failure  rate  r(t)  on 
[ 0 , t q ]  assuming  r(t)  decreasing  on  [ 0 , t^ ]  ,  where  X  ^  <_  t^  <  X^  , 
j-l,...,k+l;  we  use  only  the  observations  in  [ 0 , t q ] .  (See  Marshall 


and  Proschan,  1965.) 

(a)  Compute  as  the  unconstrained.  MLE  of  the  failure 
rate  on  (X^ _^,Xj),  assuming  it  constant  on  that  interval,  for 
i“l , . . .  ,  j-1 . 


(b)  If  t”1  >_  t”1  >_•••>_  t”^,  then  r  (t)  -  T"1  for 

Xi-1  <  1  -  Xi  (i-1 . J_1)  is  the  MLE  on  l°»xj-il* 

(c)  If,  on  the  other  hand,  a  reversal  occurs,  say 

T^  <  T^,  then  replace  each  by  [*s(T^+T^+^)] 

(d)  If  the  new  sequence  is  properly  ordered,  i.e., 

T-1  >•••>  T-1  >  lh(T  +T  *  fS<(T  +T  )1_*  >  T_1  >•••>  T_1.  . 

1  -  -  i-1  -  i  i+l;j  1,1  i  i+l/J  -  i+1  -  -  j-1’ 

then  these  represent  the  failure  rates  on  the  successive  intervals 


(xi_1,xi],  i-1 . j-1. 

(e)  If  a  reversal  exists,  then  replace  by  appropriate 
averages.  Thus  if  t4(Ti+T1+1>  ]  1  -  [^(T^T^)  ]  1  <  Ti+2>  replace 
each  of  the  three  by  the  average  [y(T^+T^+j+T^+2) 1  ^ •  Note  that 
the  average  replacing  reversed  failure  rates  is  obtained  by  taking 
the  number  of  failures  divided  by  the  total  exposure  time  during 
the  interval. 

(f)  Continue  averaging  until  all  reversals  are  eliminated. 

The  resulting  sequence  constitutes  the  MLE  fj (t)  of  the  failure 
rate  on  the  successive  intervals  (0,X^] , . . . , (Xj_2»Xj_^J . 
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(g)  On(Xj_1,t(J],  the  MLE  r ^  (t )  =  0. 

(3)  Next  obtain  the  MLE  for  r(t)  on  assuming  it 

increasing  on  (t0,°°),  where,  as  in  (2),  X  ^  <_  tQ  '  X  ;  we  use 
only  the  observations  in  ( t q ) .  The  procedure  is  similar  to  that 
described  in  (2)  just  above,  with  a  few  small  differences. 

(a)  Compute  as  the  unconstrained  MLE  of  the  failure 

rate  on  [X^  ^,X^),  assuming  it  constant  on  the  interval,  for 
i=j+l,...,k.  If  >  X^,  the  unconstrained  MLE  of  the  failure 

rate  on  [X^X^.^)  is  =0  (since  no  failures  were  observed  in 


<VW-> 

(b)  If  X^+,  >  X^,  then  a  reversal  automatically  exists 

since  >  0.  Averaging  to  eliminate  the  reversal  yields 

(T^KT^^)  *  as  the  estimate  of  r(t)  on  the  interval  fXk-l’\+l^ 

(During  that  interval  one  failure  occurred  in  a  total  exposure 

time  of  T,  +  T,  .) 

k  k+1 


(c)  We  proceed  as  in  (2)  above,  averaging  to  eliminate  all 
reversals.  In  the  present  case  a  reversal  occurs  if  any  failure 
rate  is  strictly  larger  than  the  succeeding  failure  rate.  In 
averaging,  we  take  as  the  common  estimate  of  the  failure  rate  for 
each  of  the  intervals  entering  into  the  reversal,  the  number  of 
failures  in  those  intervals  divided  by  the  total  exposure  time  tr. 
those  intervals. 

(d)  When  all  reversals  have  been  eliminated,  the  resulting 

estimate  of  failure  rate  on  [X.  ,X  -)  is  the  MLE,  r,(t). 

J  k+1  j 

(e)  On(t0,X  ),  fj(t)  =  0. 
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(4)  Compute  the  likelihood,  L^ ,  corresponding  to  £j(t): 


(a)  If  >  X^,  then 


4  -T.r^X) 

T  ?,(X.)e  1  1  1 

-1  J  1 


k  “Tifi(xi- "VlW 

f,(x,)  TT  {,(K)e  11  1  1  e  k+1  J  k 

3  3  i-j+1  3 


(2.1) 


j=l, . . . ,k 


k  -T  r  (X  ) 

£k+i  “  TT  fj(Xi)e  1  ^  1  (since  fj(t)  *  0  for  t  >  XR) . 


(b)  If  Xk+1  -  Xk,  then 


14.  -T.f.a.) 

1  T  r, (X.)e  ij  1 
i-1  J  1 


(2.2) 


Pr  .  "WW  "Tkf1(Xk-l) 
t,  (X, )  TT  r  (X  )e  J  e-  J 

3  3  i-j+1  3 

J— 1 , . • . ,k-l . 


(5)  Suppose  L  -  max |£- , . . . ,L,  . I.  Then  r.  (t)  is  the  MLE  of 

J0  '  1  *  11  J0 

r(t).  From  the  MLE  of  failure  rate,  we  can  compute  the  MLE  of  the  density 

and  the  MLE  of  the  distribution  function,  using  the  well-known  relationships 

-  T r(u)du 

Jc. 


(2.3) 


(2.4) 


f(t)  -  r(t)e 

-  /"Cr(u)du 

Jn 


F(t)  -  1-e 


3.  Examples 

3.1  Small-Scale  Worked  Example 

First  we  present  a  small  illustrative  example  to  show  in  detail  the 
steps  of  the  calculation  of  the  MLE  of  the  failure  rate.  The  failure 
times  shown  are  deliberately  selected  to  be  small  integers  so  as  to  simplify 
the  exposition.  The  algorithm  can  be  used  however  for  any  set  of  data. 


Operating  data  are  collected  on  a  fleet  of  airplanes  over  a 
fixed  period  of  time.  When  a  part  fails,  its  age  (measured  in 
operating  units  of  time)  at  failure  is  recorded,  and  the  failed  part 
is  replaced  by  a  functioning  part.  The  failed  part  is  repaired  and 
b e c o m e s  available  for  replacement.  A  part  may  be  retired  or  over¬ 
hauled  (so  that  it  becomes  as  good  as  new)  when  it  reaches  a  certain 
age.  Given  a  collection  of  data  on  a  given  part  type  (See  Fig.  1), 
obtain  the  MLE  of  the  failure  rate  r(t),  assuming  r(t)  initially 
decreasing  and  then  increasing,  with  the  turning  point  t^  assumed 
unknown . 

In  Fig.  1,  the  crosses  indicate  the  observed  times  of  failure. 
Observation  on  unit  1  begins  when  its  age  is  1  unit  of  time.  Unit  1 
experiences  failure  at  age  A.  After  repair,  unit  1  experiences  a 
second  failure  after  2  more  hours  of  operation,  i.e.,  at  age  6.  After 
repair,  unit  1  experiences  a  third  failure  after  1  more  hour  of  operation, 
i.e.,  at  age  7.  After  repair,  unit  1  experiences  failure  requiring 
overhaul  after  1  additional  hour  of  operation,  i.e.,  at  age  8.  At  this 
point  unit  1,  as  such,  disappears. 

After  unit  1  is  overhauled,  its  further  history  is  recorded  under 
the  designation  1'  on  the  second  line.  Observation  begins  at  age  0,  since 
the  unit  is  now  as  good  as  new.  Failures  of  unit  1'  occur  at  ages  5,7,  and 
9;  at  age  10  the  unit  is  overhauled.  No  additional  hours  are  logged  on 
the  unit  by  the  time  the  study  ends. 

Observation  on  unit  2  begins  at  age  0.  Successive  failures  occur 
at  ages  1,  2,  3,  4.  At  age  12  overhaul  occurs. 

Observation  on  unit  3  begins  at  age  5  and  is  discontinued  at  age  7. 

No  failures  are  observed. 


"if r  (»>»•■  1 
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V2  V3  V3  V3  V3  V4  V4 


T10=5 


Tir5  T12=1 


V° 


V° 


Fig.  1.  Operating  Data  for  Airplane  Part 
-  age  at  ith  failure,  i  -  1,  ....  11 
■  total  exposure  time  during 
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Observation  on  unit  4  begins  at  age  11.  Failure  occurs  at  age  12. 
Overhaul  occurs  at  age  13. 

Application  of  Procedure  for  Obtaining  MLE 

(1)  The  ordered  actual  failure  times  occur  at  X^  *  1,  X2  *  2, 

X3  =  3,  X4  -  4  =  X5,  X6  =  5,  X?  =  6,  Xg  -  7  =  Xg,  X1Q  =  9,  and  *n  -  12. 
In  addition,  the  last  observed  time  point  is  =  13  (no  failure 

occurred  at  this  time  point)  The  total  exposure  time  T^  in  [0,1) 
is  2,  resulting  from  1  hour  observed  on  unit  1'  and  1  hour  observed  on 
unit  2.  Similarly,  we  obtain  "  3 ,  T^  *  3,  T^  ■  3,  T^  =  0 
(since  X4  -  X5),  Tfe  =  3,  T?  =  4,  Tg  =  4,  Tg  *  0,  T1()  -  5,  Tn  -  5,  and 

T12  "  1* 

(2)  We  obtain  the  MLE  r^  (t)  for  the  failure  rate  r(t)  assuming 

r(t)  decreasing  on  [O.tg],  where  Xj_^  1  co  <  Xj ’  . .  ,k+l;  we 

use  only  the  observations  on  [ 0 , t^ J  . 

(a)  Start  with  j  ■  1.  Then  on  [O.tp] ,  r^(t)  *  0.  (No 
failures  have  been  observed  in  [0,tg].) 

(b)  For  j  *  2,  f2(t)  =  T^  *  j  on  [0,1]  and  r2(t)  *  0 
on  (1 , tQ] . 

(c)  For  j  ■  3,  the  initial  unconstrained  estimate  for 
?3(t)  is  T^1  -  j  on  [0,1],  is  T^  ■  j  on  (1,2],  and  is 
0  on  (2,tg].  Since  j  >  j  0,  no  reversals  exist,  and  thus 
the  initial  unconstrained  estimates  constitute  the  MLE  on  [O.t^]  * 

(d)  We  continue  in  this  fashion  obtaining  r^(t)  and  f^(t), 
with  no  reversals  occurring  in  [0,tg]. 


- - 


-10- 


(e)  A  reversal  occurs  in  computing  r^(t).  The  initial 
estimates  of  failure  rate  on  the  successive  intervals  are 


y,  3’  ”3’  3’  "*  °*  Since  ■  y  < 


we  pool,  obtaining 


-1  2 

as  the  new  estimate  of  failure  rate  on  (X^.X^],  2(T^+T^)  ■  y. 

The  new  sequence  of  trial  estimatec  of  the  failure  rate  still 

1112  2 

exhibits  a  reversal:  y,  y,  — ,  — ,  — ,  0.  We  pool  again  to  obtain 
a  new  trial  estimate  of  failure  rate  on  (X2»X,.],  3(T^+T^+T^)  ^  = 


3 

(> 


The  new  sequence  of  trial  estimates  still  exhibits  a  reversal: 

y,  y.  y,  y,  y,  0.  Pooling  again,  we  obtain  4(T2+T3+T^+T5>  1  *  y 

as  an  estimate  of  the  failure  rate  on  (X^.X^].  The  new  sequence 

1  A  4  4  A 

of  failure  rate  estimates  exhibits  no  reversals:  y,  y,  y,  y,  y,  0. 
We  conclude  that  r^(t)  *  y  on  [0,1],  r^(t)  *  y  on  (1,4],  and 

?6(t)  -  0  on  (4,tQ] . 

(f)  In  a  similar  fashion,  we  obtain  r^ (t)  on  [O.tp]  for 
j  -  7,  8,  9,  10. 

(3)  Next  obtain  the  MLE  fj(t)  for  r(t)  on  (tp,®),  assuming 

it  increasing  on  (t^,°°),  where  X^^  bp  <  Xj  ’  . k+l»  we 

use  only  the  observations  in  (tp,°°). 

(a)  Start  with  j  -  1.  On  [  tQ ,  1) ,  r^t)  *  0.  The  initial 
trial  estimate  for  r^(t)  on  [1,2)  is  T^  **  y,  on  [2,3)  is 
T~*  ■  y,  or.  [3,4)  is  T^1  *  y,  etc.  Next  we  examine  these 
trial  estimates  on  successive  intervals  to  see  if  a  reversal  exists 
y,  y,  y,  «,  y,  y,  y,  »,  y,  y.  0.  (The  estimate  0  corresponds 
to  no  failures  observed  in  an  exposure  time  of  1  in  the  final 
interval  [12,13].) 
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To  eliminate  the  reversal  ®  we  pool  to  obtain  the  new 

estimate  2(T^+T5)  1  =  on  [3,4). 

112  2  111 

The  new  sequence  of  failure  rate  estimates,  — ,  — ,  — ,  — ,  — ,  — , 

",  T»  y  0,  still  contains  reversals.  We  continue  to  pool  to 
eliminate  reversals  until  we  finally  obtain  the  single  failure  rate 
estimate  r^(t)  =  over  the  entire  interval  [1,13]. 

(b)  Next  suppose  j  =  2.  Then  ^(t)  *  0  on  [  t^ ,  2 ) . 

9 

Proceeding  as  in  (a)  we  obtain  the  single  failure  estimate  *  "Jg 

on  [2,13]. 


(c)  In  a  similar  fashion  we  obtain  r^Ct)  =  0  on  [t^,3). 
Again,  we  are  required  to  pool  on  the  entire  remaining  interval  to 

g 

obtain  the  single  failure  estimate  r^(t)  =  Tfjr  on  [3,13]. 

The  results  of  steps  (2)  and  (3)  are  summarized  in  Table  1. 


Interval  assumed  to  contain  t^ 


0,1 

1,2 

2,3 

3,4 

4,5 

- 

5,6 

6,7 

7,9 

9,12 

12,13 

1 

0 

.3226 

.3226 

.3226 

.3226 

.3226 

.3226 

.3226 

.3226 

.3226 

2 

.5000 

0 

.3214 

.3214 

.3214 

.3214 

.3214 

.3214 

.3214 

.3214 

3 

.5000 

.3333 

0 

.3200 

.3200 

.3200 

.3200 

.3200 

.3200 

.3200 

4 

.5000 

.3333 

.3333 

0 

.3182 

.3182 

.3182 

.3182 

.3182 

.3182 

5 

.5000 

.4444 

.4444 

.4444 

0 

.2500 

.2500 

.2727 

.2727 

.2727 

6 

.5000 

.4444 

.4444 

.4444 

.3333 

0 

.2500 

.2727 

.2727 

.2727 

7 

.5000 

.4444 

.4444 

.4444 

.  3333 

.2500 

0 

.2727 

.2727 

.2727 

8 

.5000 

.4444 

.4444 

.4444 

.3636 

.3636 

.3636 

0 

.1667 

.1667 

9 

.5000 

.4444 

.4444 

,4444 

.3636 

.3636 

.3636 

.2000 

0 

1.0000 

10 

.5555 

.4444 

.4444 

.4444 

.3636 

.3636 

.3636 

.2000 

.2000 

0 

Table  1 

|  th 

The  i  -interval  is  open  on  the  left  and  closed  on  the  right  for 
i  ■  1,  ...,  j  -  1,  and  is  closed  on  the  left  and  open  on  the  right 
fcr  i  ■  j  ,  . . . ,  10. 


-12- 


(4)  Next  we  compute  the  likelihood  corresponding  to  r^Ct) 

for  j  ■  1 . 10.  Since  some  exposure  time  has  occurred  beyond  the  last 

observed  failure,  we  use  formula  (2.1).  We  display  the  natural  logarithm 
of  each  likelihood  in  Table  2. 


J 

tn  S 

j 

tn  Lj 

j 

in  Lj 

1 

-.2131  +  2 

5 

-.2061  +  2 

9 

-.2059  +  2 

2 

-.2091  +  2 

6 

-.2032  +  2 

10 

-.1959  +  2 

3 

-.2091  +  2 

7 

-.2032  +  2 

4 

-.2091  +  2 

8 

-.1978  +  2 

Table  2 


Note  that  is  the  largest.  Thus  the  MLE  of  the  failure  rate 

is  given  by  (t )  in  Table  1. 


.5 

.4 

ht) 

.3 

.2 

.1 

0 

0  1  2  3  4  5  6  7  8  9  ID  11  12  13 

Age,  t 

Fig.  2.  Maximum  Likelihood  Estimate  of  the 
Failure  Rate  Function 


3.2  Real  Life  Aoolication 


The  maximum  likelihood  estimate  of  the  failure  rate  of  a  constant 


speed  drive  of  a  jet  airplane  was  obtained,  assuming  the  failure  rate 
initially  decreasing  and  then  increasing.  The  data  was  obtained  over  a 
one  year  period  (1964),  and  contains  141  observed  failures.  Because  of 
the  large  number  of  observations,  we  do  not  present  the  raw  data,  but 
show  the  maximum  likelihood  estimate  r(t)  of  the  failure  rate  in  Fig.  3 
the  maximum  likelihood  estimate  F(t)  of  the  survival  probability  in 


Fig.  4,  and  the  maximum  likelihood  estimate,  Fcn(t)  * 


F(t+50)  -  F(t) 


MLE  of  £(t) ,  the  failure  rate  function 
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o  to  no  noo 

Ago* 


Fig.  4.  MLE  of  F(t),  the  survival  probability 
function 


bability  of  failure  in  the  next  50  hours 
given  survival  until  age  t 


of  the  conditional  probability  of  failure  in  the  next  50  hours,  given 
that  the  unit  is  alive  at  age  t,  in  Fig.  5. 


4.  Derivation  of  the  Maximum  Likelihood  Estimate 
4.1  The  Case  ^ 

Lemma  4 . 1  Assume  r(t)  is  decreasing  on  [0 , ]  and  increasing 
on  (tg,00).  Then  r(t)  is  constant  between  successive  failures; 
specifically  r(t)  has  the  form  (4.3). 


Proof  Note  that  the  likelihood  expression  is  composed  of  factors 
of  the  following  types :  Y., 


-/  . 
J  a 


(u)  du 


(4.1) 


(4.2) 


r(Y1)e 


"/a/  r(u)du 


(4.1)  represents  the  likelihood  of  a  unit  failing  at  age  Y^  given 
that  it  is  alive  at  age  a^,  while  (4.2)  represents  the  likelihood  of 
a  unit  surviving  until  age  b^  given  that  it  is  alive  at  age  a^. 

It  follows  that 


* 

ri 

for  Xi_1  <  t  f  Xi,  1  < 

i  <  j  -  1 

for  j  >  1, 

(4.3)  r*(t) 

n  • 

0 

for  Xj_^  <  t  <  X j , 

ri 

for  X±  <  t  <  Xi+1,  j  < 

i  <  k  for 

j  <  k*+  1 

minimizes  J 

^  r(u)du 

a 

for  0  f  a  <  b  <  X^+^ 

among  all 

r(t)  satisfying 

u 

the  assumptions 

that 

r(t)  is  decreasing  on 

[o,t0], 

increasing  on 
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(tg,®),  and  ■  at  Xi  for  1  -  This  follows  from  the  fact 

that  r*(t)  is  as  small  as  possible  at  every  value  of  t,  0  i  t  i  \+l» 
consistent  with  the  assumptions .  |  | 

Next  we  must  determine  the  set  of  values  r^  -  r(X^) ,  i  * 
which  maximizes  the  likelihood.  To  do  so  we  first  express  the  likelihood 
Lj  in  terms  of  the  r^,...  r^  and  1^, . . .  .T^^,  assuming  the  turning 

point  tQ  satisfies  X^  ^  i  tg  <  X j ,  where  j  may  be  1 . k+1.  Note 

that  if  tg  1  X^+i*  the  likelihood  reduces  to  the  value  for  the  case 

C0  < 

both  cases  the  failure  rate  must  be  taken  0  on  the  interval  (X^,00) 
order  to  maximize  the  likelihood. 


+1* 


namely  L, 


k+1* 


This  is  a  consequence  of  the  fact  that  in 


Lemma  4.2  Lj  is  given  by 


(A. 4) 


ft  »/* 

i-1  1 


-r  T 
i  i 


k  ,T.  -r,  T,  ,  i 

ni-1  i  k  k+1 
re  e 

Ji-j+l 


for  J  -  1,. . ,,k; 


(4.5)  -  TT  v’'1*1 

i-1 

0  k 

where  products  of  the  form  |  |  ,  ]  [  are,  of  course,  vacuous. 

i-1  k+1 

Proof  Consider  a  typical  interval  (X^.X^,  where  say  i  Z  j  -  1. 
Suppose  in  this  interval  exposure  periods  of  duration  *  * ,Tm  have 

been  observed,  one  of  which  (say  the  hth)  ends  in  failure  at  time  X^. 

"riTl  _riT2  "riTh-l 
The  corresponding  likelihood  of  factors  are  e  ,e  ,...,e  , 


rie 


“Vh  “Vh+l 

.e 


-r,  t 
i  m 


-r  T 
Ti 


. e  ,  with  product  r^e  ,  since  by  definition 


T.  -  T-+...+T  . 

i  1  m 


<•*!* •****■*! , 
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The  other  factors  in  (A. A)  and  (A. 5)  may  be  obtained  in  a  similar 
fashion. | | 

Next  we  note  that  to  maximize  given  by  (A. A)  subject  to  both 

r,  -  r_  >  . . .  r.  .  1  0  and  0  <  r.  i  r.,,  <  ,,,  i  r.  ,  it  suffices 

1  2  j-1  j  j+1  k’ 

subject  to  r^  *  *  . . .  *  r^  ^  1  0, 

k  -r._.T.  -r.  T.  . 

(b)  to  maximize  r  "|  [  r  e  e  subject  to 

Ji«j+1 

j  -  j+i  -  •••  -  rk* 

Consider  problem  (a).  Let  r^  *  ...  >  r^  ^  denote  the  maximizing 
set.  Then  we  will  need: 


-r  T 

n  i  Ai 
r  e 

i*l  1 


and  separately 


Lemma  A. 3  Let  r* . r*_^  denote  the  set  maximi 


44  -riTi 

»  i  tig  ||re 

i-1 


subject  only  to  r^  i  0,  i  -  l,...,j-l.  If  for  some  i  (l*i<j-l)  ,  r*  <  r*+^, 


then  r 


i  “  ri+r 


Proof  It  suffices  to  show  that  r^  >  r^+^  implies  r£  1  r*i+i 


-r  T 

-  i  i 

Assume  then  that  r^  >  r^+^.  It  is  easy  to  verify  that  r^e 

-1  "*ri^i 

has  a  unique  maximum  r*  ■  ,  and  that  r^e  is  increasing  for 

0  -  ri  -  r*  and  decreasing  for  r*  5.  r^. 

Now  r1  >  r2  >  ...  >  ri  >  ?1+1  1  ...  >  r^.  Suppose  r*  <  r^ 

Let  r^  -  max(r*,ri+1) .  Then  >  ?2  l  ...  >  rJ_1  >  rj  >  ?i+1  >  ...  >  r^. 

-  -  ”ri^i  "ri^i 

Since  ri  >  r^,  then  ^e  <  r^e  ,  which  is  a  contradiction, 

since  it  would  imply  that  -  r2  -  •••  -  is  not  the  maximizing  set. 

Thus  r*  >  r^.  Similarly  we  may  show  r*+^  - 

r*  >  r*  .  I  I 
i  ~  i+1  1 1 


It  follows  that 
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Thus  ir  there  is  a  reversal  in  the  unrestricted  maximum  likelihood 


and  solve  the  unrestricted  problem,  where 


estimates,  say  r*  <  r*  . ,  then  r  «■  r  .  In  this  event,  set 
.1-1  =r?T  1  1+1 

ri  "  ri+l  in  ]7  rie 

now  r^  ■  r^+^.  We  now  obtain  as  the  new  trial  estimates 

r**  ■  r**^  ■  [b(T^+T^+^)  J  T  It  is  clear  that  repeated  applications  of 

Lemma  4.3  (and  its  analogue  on  [ t^ ,°°) )  results  in  the  Procedure  described 

in  Section  2  for  obtaining  the  maximum  likelihood  Lj  assuming 

X.  x  —  tg  <  X j  »  j“l»  •  •  •  »k+l ,  or  X^_^_2  -  cg* 


It  is  apparent  that  to  obtain  the  MLE  assuming  t^  unknown,  i.e., 

to  solve  the  original  problem,  we  simply  compare  the  L^  ,  j*l . k+1,  and 

find  the  largest;  it  corresponds  to  the  maximum  likelihood,  as  described 
in  Section  2. 


4.2  The  Case  X^  ■  X^+1 

In  this  case,  distributions  placing  mass  at  must  be  considered. 

In  fact  since  they  dominate  those  placing  no  mass  at  X^  (with  respect 
to  the  magnitude  of  the  likelihood),  we  need  consider  only  distributions 
placing  mass  at  X^.  Confining  ourselves  to  such  distributions,  we  may 
show  by  an  argument  similar  to  that  of  Lemma  4.1  that  the  MLE  has  constant 
failure  rate  between  successive  observed  failures. 


To  write  down  the  likelihood  L^  assuming  Xj_^  -  cg  <  X^ 

Then 


we 


define  as  before  r^  ■  r(X^)  ,  i«l,...,k-l. 


(4.6) 


lj  ■ 


1-1 

TT  v 

i-1  1 


-T  r 
i  i 


k-1 

rj  TT  rt' 

Ji-j+l 


“^i  ri_i  “\rk-i 

e  1  Xe  K  K  1  for  j-1 . k-1. 


The  justification  of  (4.6)  is  similar  to  that  of  (4.4)  and  (4.5),  except 


that  in  the  likelihood  expression  we  set  equal  to  1  the  conditional  pro¬ 
bability  of  a  unit  failing  at  time  given  that  it  has  survived  until 

time  without  failure.  Note  that  the  expression  in  (4.6)  coincides 

with  that  of  (4.4)  with  k  -  1  in  place  of  k. 


As  in  Section  4.1,  we  maximize  the  likelihood  expression  in  (4.6) 
subject  to  r^  £  . . .  1  rj_^  r j  “  *  *  *  “  rk  1  separately 

maximizing 


(a) 


ft 

i-1 


subject  to 


and 


k-1  -T.r.  ,  -T.  r,  - 

/u\  TT  i  i-1  k  k-1 

(b)  r  ||re  e 

Ji-1+1  1 


subject  to  r 


j  " 


<  r 


k-1* 


The  solution  is  as  given  in  Section  4.1,  where  of  course  k  +  1  is  re¬ 
placed  by  k.. 


5.  Consistency  of  the  Estimate 

In  this  section  we  prove  that  the  maximum  likelihood  estimate  of  the  failure 
rate  described  in  Section  2  is  consistent.  I.e.,  as  the  number  of  obser¬ 
vations  increases  to  infinity,  the  estimate  converges  to  the  true  value 
with  probability  one. 

Since  the  proof  of  consistency  is  rather  long  and  involved,  we  give 
a  sketch  of  the  main  ideas  used. 


Method  of  Proof  If  the  MLE  r  (•)  converges  weakly  to  some 
-  n 

U-shaped  limit  r(*)>  then  we  first  show  (Lemma  5.2),  using  the  methods 
of  Marshall  and  Proschan  (1965),  that  r(*)  is  a.s.  equal  to  r(*)  at 
those  points  where  7(*)  and  r(»)  are  both  increasing  or  both  decreasing. 
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The  demonstration  depends  on  the  form  of  the  estimate;  the  fact  that 

r  (•)  is  the  MLE  is  incidental  in  the  demonstration, 
n 

Next  we  must  show  that  r(*)  and  r(*)  cannot  have  different 
turning  points.  If  we  assume  that  they  do,  we  arrive  at  a  contradiction 
by  constructing  the  estimate  ^n(*)»  the  MLE  given  the  true  turning 
point,  and  then  showing  that  with  probability  1  it  is  asymptotically 
more  likely  than  rn(*)»  (which  is  the  MLE  over  a  larger  class  of 
U-shaped  failure  rates)  . 

The  proof  that  r  (•)  is  more  likely  than  r  (•)  uses  a  uniform 
bound  on  the  failure  rate  over  the  interval  of  possible  disagreement  of 
r(*)  and  r(*)-  The  existence  of  this  bound  requires  a  separate 
argument  if  r(*)  is  monotone  instead  of  strictly  U-shaped.  (See  Lemma 
5.5.) 


Definitions 

We  use  the  notation  r  (•)  for  t^ie  MLE  °f  the  U-shaped  failure  rate, 
based  on  a  sample  of  size  n,  as  described  in  Section  2. 

Given  a  U-shaped  failure  rate  r(*)  we  shall  say  that  y  is  a 
point  of  decrease  ( 'increase )  of  r(*)  if  in  every  neighborhood  of  y 
there  exists  u,  v,  u  <  y  <  v  such  that  r(u)  >  r(v) ;  (r(u)  <  r(v)). 

A  point  t  is  said  to  be  a  turning  point  for  r(*)  if  r(*)  has 
no  points  of  decrease  greater  than  t  and  no  points  of  increase  less 
than  t . 

We  say  that  a  sequence  of  functions  ^n(*)  converges  to  a  function 
f(*)  in  the  weak  sense  if  f^(x)  converges  to  f(x)  for  all  points  of 
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continuity  of  f(‘). 

Corresponding  to  a  sample  of  size  n,  let  F  (•)  be  the  empirical 

distribution  function,  i.e.,  F  (y)  »  —  ‘(number  of  failures  observed  to 

n  J  n 

have  occurred  by  time  y) .  If  F^C*)  converges  in  the  weak  sense  to 
some  limit  Fq(‘),  note  that  F(‘)  will  not  in  general  be  the  true 
distribution  function;  this  is  a  consequence  of  the  truncation  of  the 
data. 


Given  an  interval  I  ■  (x,y)  and  a  hazard  rate  r(‘),  we  define 

a  measure  of  likelihood  of  r(*)  on  I  as  follows: 

(t)r(t)dt^ 

where  N  (t)  is  the  number  of  units  on  test  at  time  t.  Here  and  in 
n 

the  sequel  the  sum  will  be  understood  to  extend  over  all  i  such  that 
X±  is  in  I. 

Theorem  5.1  If  the  empirical  distribution  function  F  (•)  converges 
a.s.  to  an  absolutely  continuous  distribution  function  Fq(*),  and  if  the 
true  failure  rate  r(‘)  is  strictly  positive  on  the  support  of  Fq ( • ) , 
then  on  (0,«>)  r^C*)  a.s.  converges  in  the  weak  sense  to  r(*)  on  the 
support  of  Fq(*),  except  possibly  at  some  one  turning  point  of  r(‘). 

Proof  Assume  for  the  sake  of  simplicity  that  the  support  of  Fq(*) 
is  [0,“).  If  t^  is  a  turning  point  of  £^(0,  then  there  exists 
a  subsequence  t^n^  which  converges  to  some  t^  in  [0,°°]. 

If  r  ,  . 
m(n) 


•n)  '  ;<V  '  f\ 

n  \  x 


(*)  is  a  sequence  of  U-shaped  functions  assuming  values 
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in  [0,®]  with  turning  points  converging  to  a  limit,  then  it  follows 

as  in  the  Helly  weak  compactness  theorem  that  r  .  .(•)  has  a  sub- 

m(n) 

sequence  which  converges  to  a  U-shaped  function  7(*)  at  points  of 
continuity  of  the  latter;  moreover,  tQ  is  a  turning  point  of  7(0. 

To  prove  consistency  of  the  estimate  r  (•)  it  will  suffice  to 

n 

show  that  7(0  ■  r(0  at  the  continuity  points  of  r(0»  for  it  then 
will  follow  that  every  subsequence  of  r  (•)  has  a  subsequence  which 
converges  to  r(0  in  the  weak  sense.  Hence  r  (•)  will  be  convergent 
to  r(0  in  the  weak  sense  (cf.  Kelley  (1955),  p.  74,  statement  (c)). 

Let  ^£(n)(0  be  a  subsequence  which  converges  in  the  weak  sense 
to  7(0.  and  whose  turning  points  converge  to  t^.  In  the  sequel  we 
will  be  concerned  only  with  this  subsequence;  for  notational convenience 
we  will  refer  to  this  fixed  subsequence  as  r^  ( • )  ,  and  the  respective 
turning  points  as  t^;  thus 

rn(0  ”  r(  0  » 

t  -*•  tn. 
n  0 

Let  tfc  be  a  turning  point  of  r(0» 

Corresponding  to  the  sample  of  size  H(n)  (from  which  the  MLE 
r  (•)  was  calculated),  let  the  empirical  distribution  function  be  denoted 

V 

by  F  (•)»  and  let  r  (•)  denote  the  MLE  of  the  hazard  rate  given  the 
n  n 

turning  point  tt>  Then  Fn(*)  converges  to  FQ ( * ) ,  with  FQ(*)  absolutely 

V 

continuous,  and  it  follows  from  Marshall-Proschan  (1965)  that  r  (•) 

’  n 

converges  in  the  weak  sense  to  r(*)  everywhere  on  the  support  of  Fq(*), 


-23- 


except  possibly  at  tt< 

The  proof  of  Marshall  and  Proschan  is  stated  for  the  case  where 
the  data  is  uncensored;  however,  the  arguments  are  applicable  in  the  pre¬ 
sent  situation  if  we  replace  the  ^  of  their  proof  by  the  ^  of 
Lemma  5.2  below. 

It  follows  from  Lemma  5.2  that  if  a  is  the  supremum  of  the  points 

of  decrease  of  r^*)  less  than  ( t_ /t  ),  and  lim  r  (a+)  <  then 

U  t  n 

7(a  )  =  r(a  )  a.s.  and  T(a+)  =  r(a+)  a.s.  (In  particular,  lim  rn(a+)  <  00 
for  a  >  0.)  Thus,  regardless  of  whether  a  is  a  point  of  continuous 
decrease  or  a  jump  point  of  ?(•)»  it  is  a.s.  a  point  of  decrease  for 

r(-). 


Since  a  is  a  point  of  decrease  of  r(*),  it  follows  that  there 
must  be  a  sequence  sn»  where  sn  is  a  jump  point  of  rn(*)»  such  that 
sn  converges  to  a.  If  t*  <  a,  then  for  arbitrary  e  >  0  we  must 
have  t*  <  s^  <  a  +  e  for  n  sufficiently  large.  In  this  case  rn(t*) 
is  an  average  which  cannot  extend  to  the  right  of  s^;  hence  for  e  >  0 
and  sufficiently  large  n,  rn(t*)  is  an  average  which  cannot  extend  to 
the  right  of  a  +  e. 

Similarly,  since  rn(*)  is  consistent,  rn(t*)  is  an  average  which 
for  sufficiently  large  n  a.s.  cannot  extend  to  the  right  of  a  +  6,  for 

a  V 

arbitrary  small  6  >  0.  Thus  it  can  be  shown  that  rn(t*)  and  rn(t*) 
have  a.s.  for  large  n  the  same  functional  form,  and  are  therefore  equal 


for  all  t  1  t*. 
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Two  consequences  are  immediate: 

i)  r( •)  -  r(*)  a.s.  on  (0,a) 

U)  ^(0,a-c]('n(-)>n)  ‘  ■e(0,a-£](fn(')>n)  ““h  probability 

1  for  sufficiently  large  n. 

Similarly,  if  b  is  the  infimum  of  the  points  of  decrease  of 
r(*)  greater  than  (tgVtt),  b  <  ®,  then 

iii)  r(*)  ■  ?(•)  a.s.  on  (b,°°) 

lv)  i?[b+e,«)(^n(*),n)  "  ^[b+e,»)(^n(,)’n)  a.s.  with  probability 
1  for  sufficiently  large  n. 

The  case  a  ■  0  or  b  ■  °°  is  considered  in  Lemma  5.5. 

It  follows  from  Lemma  5.2(a)  that  on  the  open  interval  (a,b)  'r(-) 

can  have  at  most  two  jump  points  (at  t^  and  tt> . 

The  proof  is  completed  by  assuming  that  a  <  b  and  r(’)  is  not 
equal  in  the  weak  sense  to  r(*)  on  (a,b)  and  then  proving  the  contra- 

V  * 

dictory  statement  that  r  (•)  is,  for  large  n,  more  likely  than  rn(')- 

Now,  r  (•)  and  ?*(•)  are  uniformly  bounded  on  (a,b)  ,  0  <  a  <  b  <  «. 
n 

From  the  fact  that  r  (•)  is  unimjdal  and  is  consistent  off  (a,b),  it 

n 

A  ^ 

can  be  seen  that  for  small  e  >  0,  r  (*)  and  r(')  are  a.s.  uniformly 

n 

bounded  on  the  interval  I  ■  (a-e,b-K). 

Similarly,  on  I  r  (•)  is  a.s.  uniformly  bounded  above  and  below. 
Therefore,  in  the  limit  ^(r  ( •)  ,n)  and  ^(riO.n)  are  almost  surely 
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equal. 

Since  ?(•)  *  r(*)  a.s.  off  J  *  (a,b),  the  result  of  Lemma  5.4 
holds  with  J  replaced  by  I.  If  a  ^  b  it  then  follows  from  Lemma 
5.3  that  with  probability  1,  r ( * )  is,  in  the  limit,  more  likely  than 
*)  on  and  for  large  n  rn(*)  and  rn(*)  are  equal  off  I.  Thus, 

if  a  y  b,  r^O)  1®  d°r  large  n  a.s.  more  likely  than  which  is 

a  contradiction.  Hence  we  must  conclude  that  a  ■  b  ■  t^  *  t  ,  and 
with  the  possible  exception  of  this  point  r^*)  is  equal  to  r(*)  in 
the  weak  sense  with  probability  l.|  | 


Lemma  5.2  Let  t  be  a  point  of  increase  or  a  point  of  decrease  of 
r'(").  Then,  with  probability  1, 

a)  r(t')  -  r(t"),  r(t+)  -  r(t+)  if  t  c  (O.^a^), 

b)  r(t  )  -  r(t+)  -  7(t~)  *  7(t+)  if  t  e  (t0Att'tovtt^  ’ 

c)  r(t")  *  r'(t")  ,  r(t+)  =  r'(t+)  if  t  e  . 

Proof  First  we  will  assume  t^  >  t  >  t^ ;  the  case  t^  <  t  <  tfc 

^  ^  mm  ^  — 

may  be  treated  similarly.  We  show  r(t  )  1  r(t  )  and  r(t  )  >  r(t  )  . 


For  the  first  inequality,  take  t^  and  t*  such  that 
t  <  t^  <  t*  <  t,  Then,  for  sufficiently  large  n,  r  (•)  is  decreasing 
at  t*,  and  has  a  jump  point  which  converges  to  t.  Therefore,  for 
small  e  >  0  and  sufficiently  large  n, 


ijt*) 


min 

v:t*<x  it+e 
v 


v-1 

max  — \  T  . . 

u:0<x  <t«  v-u  £  "•1 
u  i»u 
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The  upper  limit  on  the  range  of  v  follows  from  the  fact  that, 
for  large  n,  ^n(*)  has  a  jump  point  in  (t*, (t+e)Atn) . 

Here  and  in  the  sequel,  let 


f  i+1 

l  <  -  J  N  (t)r 
n ,  i  j  n 


(t)dt. 


The  ^  are  independent  exponential  random  variables  with  mean  1. 


T  .  may  be  written: 
n,i  J 


f  i+1 

rn,i  '  J  Vt)dt' 


Then,  letting  k(t)  be  the  largest  k  such  that  1  t : 

v— 1 

_ 1  . 


*  min 

n'1  v:t*<x  <t+e 

v 


v~k(t+)  S  ^n ,  i " 

l«k(t; 


For  this  range  of  i: 


>  Z  /r(t+e) . 
n,i 


Therefore 


min 


r(t+E)  v:t*<7;t«  v-k(lT) 


v-1 

2 

•k(t+) 


n,i’ 


and  the  result  r(t+e)  >  r’(t*)  a.s.  follows  from  a  form  of  the  strong 
law  of  large  numbers  as  in  Marshall-Proschan  (1965) . 


.  +. 


To  prove  the  inequality  r(t  )  1  r(t  )  a.s., 


same.  Take  t  <  t*  <  t  <  tQ;  then  for  arbitrary 


the  procedure  is  the 
e  >  0  and  large  n, 
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we  have 


1 

r  (t*)  " 

u 

< 

rnct*)  - 

For  this  range  of  i, 
before. 


v— 1 


min 

v:t*<x  ft 
v  n 


max  — —  7  T  . , 

u:t-efx  <t*  v_u,  n»i 


u  ,  i-u 
k(tT)-l 

k(t+)-u  Z  n,i 


u:t-efx  <t* 
u“ 


i-u 


Tn,i  "  Zn,i^r^t-C^ *  and  the  result 


follows  as 


in 

+ 

t 


We  briefly  outline  a  proof  for  the  case  t  <  tQ  a  tt;  the  proof 
the  case  t  >  tQ  v  is  similar.  To  show  r(t~)  >  r^t-)  ,  take 
<  t*  <  t.  Then 


v-1 


r  (t*)  "  min  max  v 

n  v:t*<x  <t+e  u:0<x  <t* 

v  u  i-u 


-y* < 

-u  zL  n,i 


v-1 


f  min 
v:t*<x  ft+E 


v-t  2  Zn,i/r(t  J ‘ 
i-k(t) 


Hence  r(t+)  >  r^t*)  a.s.  To  show  r(t~)  <  r(t'),  take  t*  <  t+  <  t 


Then 

1 

k(t+) - 

.  <  mav  1  V 

•1 

Zn  ,/r(t+). 
n,i 

-  ma*  tt-u  Z 

u:x  <t*  , 

u  i-u 

Therefore 

r(t+)  <  7(t*) 

a.s.,  and  the  result 

r(t  )  *  ”r(t  )  follows 

The  proof  that  r(t+)  -  7(t+)  a.s.  is  similar.  || 
Lemma  5 . 3  Let  I  -  (a-e,b+e).  Then 


lim  .£  (r  (•)  .n)  -  -®  a.s.,  or 

n  i  n 

limJ^r^O.n)  -^(^(O.n)]  -0  a.s. 


* *******  •m- 
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Proof  rn(*)  converges  to  r(*)  a.e.  with  respect  to  F(*)  on 
I.  It  follows  from  Egoroff's  theorem  that  this  convergence  is  almost 
uniform  on  I;  that  is,  given  c  >  0  there  exists  a  set  E  C  I,  F(E)  < 
such  that  r  (•)  converges  uniformly  to  ”?(•)  on  I  —  E. 

Now : 


•^l(rn(*),n)  -£I(‘r(‘),n) 


VE>  r 


F„<') 


^E(rn(*),n)  -  i?£(r'(*)  ,n) 


F  (I*-E) 
n 

F„(I) 


[£I~E(V')’n)  -•ei~E(F(')*,l) 


Recall  that  r(*)  assumes  its  minimum  value  between  a  and  b 

and  is  piecewise  constant  there.  Hence  either  “?(•)  is  bounded  away 

from  zero,  or  (since  the  r  (•)  are  bounded  above)  lim  £_  „(r  (*),n)  - 

n  n  n 

In  the  former  case  r(*)/tn(*)  converges  uniformly  to  1.  Hence 


limn  *I~F(*n(,)*n)  "  *I~E('(*),n) 


lim 


IwyKli^rTv  F  { i1 

n  1  n  l  T  _  n 

I~E 


lim  max 
nl"SeI~*E 


lg 


m.. 


rn(s) 


+  MX  U.rtiL 

scI-El  rn  8 


-  0. 


Using  the  uniform  bound  on  r^C8)  and  r"(*)  mentioned  in  the  hypo 
thesis  and  the  fact  that  r(*)  is  bounded  away  from  zero,  the  contribu¬ 
tion  of  the  likelihood  over  E  may  be  made  arbitrarily  small.)  | 


-29- 


Lemma  5.4  Let  J  “  (a,b) .  Ther 

limn[^j(r(*)  *n)  ”  £j(7(‘)  »n)J  >0  a.s. 

Proof  As  mentioned  above,  it  follows  from  Lemma  1  that  r(*)  has 
at  most  two  points  of  increase  or  decrease  in  J.  Thus,  unless  r(*)  *  r(*)» 
there  is  at  least  one  subinterval  of  J  with  positive  F(*)  measure 
whereon  r"(*)  is  constant  and  not  equal  in  the  weak  sense  to  r(*).  Let 
M  be  such  a  sub  interval  on  which  “?(•)  =  ”r,  say. 

Then,  letting  m  -  S.(n)Fn(M),  we  have 

L(n)  *^M(r(*),n)  -^M(r(*),n)  - 


'  "  Zn,i  “  ln  ~  +  ~/  i+\(t)dt. 

xi 

Differentiating  with  respect  to  7  and  using  the  value  which  minimizes 
L(n)  for  each  n,  we  have: 

L(n)  >  ln^l/  Nn(t)dt^  -  ^IlnU/^x^]  - 


We  may  write 

fi+l 

/  N  (t)dt 
J  n 


Zn,l/ri’ 


min  r(t) 
tc  (x^x^) 


-ri- 


max  r(t) 
te (x1,xi+1) 


Thus 


L(n)  i  lni2z„_1/r1  -  ;2l»U/r(xs) )  - 

/  (Z  .-l)/r  \  /  l/r±  ^ 

"  T  +  — IK  )  + 


■4 
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As  in  Marshall-Proschan  (1965),  the  quantities  in  braces  tend  a.s.  to 

zero  by  the  Hajek-Renyi  inequality.  By  the  same  inequality,  the  difference 

inside  the  square  brackets  can  be  shown  to  have  a  positive  lower  bound  unless 

r(*)  is  constant  on  M.  Also  ^1/r.  >  Vl/Wx.,)  -  — —  — -7 — -  .  Therefore, 

i  i  min  r(.x.; 

xiinM 


hh 


lnl 


Vl/r(xi)> 


Mn  1  - 


min  r(x^) 
Vl/rCx^ 


which  tends  to  zero  a.s. 


Hence  L(n)  has  a  positive  lower  bound  unless  r(*)  is  constant 
on  M. 


There  remains  only  the  case  where  r(*)  is  constant  on  M. 

If  r(*)  and  r(*)  are  constant  on  M,  then  the  difference  in  the  mea¬ 
sures  of  likelihood  over  M  may  be  written  as 


(f  -  +  ln  r  -  ln  7’ 


which  converges  a.s.  to 

f(r)  =  ^  -  1^  +  ln  r  -  ln  r. 

It  may  be  seen  that  t(r)  has  a  unique  minimum  at  r  ■  r,  and  that 
f(r)  =  0.  Therefore  unless  *?(•)  =  r(*)  on  M,  we  have 


lim 

(Alternatively , 
we  may  redefine  tfc 
except  possibly  at 


^M(r(*),n)  -i?M(7(-),n) 


>  0. 


if  r(-)  is  constant  over  (toAtt»tgvtt) , 
to  be  equal  to  tQ  and  it  follows  that  r(*) 


V*’ 


then 

w  . 
-  r( •) 


t 


-31- 


Lemma  5.3  If  a  =  0,  then  for  small  e  >  0, 

Umn[£(0,cl('n(-)'n)  -•e(0,c]('n<-,'n)]  -°  a‘ 
If  b  =  *>,  then  for  N  sufficiently  large, 

U"n[J?[N,-t.)(r„(-)'n)  -  -e[N,+-><:fnt*><,,>]  -° 


0  a.  s 


Hence  the  conclusion  to  the  main  theorem  follows  as  before. 

Proof  For  the  case  a  =  0  we  begin  by  assuming  t  >  0.  Recall 

that  the  only  difficulty  in  applying  the  methods  of  Lemmas  5.3  and  5.4 

occurs  when  lim  r  (0+)  =  °°.  In  this  case  take  e  >0,  c  <  and 

n  t 

if  tQ  >  0,  take  e  <  tQ.  Then  ?(•)  is  constant  over  all  such  possible 
value-  _  £  c. 

Let  be  a  sequence  of  jump  points  of  rn(*)  which  converges  to 

0.  (If  no  such  sequence  exists,  it  is  easy  to  demonstrate  that  rn(0  ) 
is  uniformly  bounded.) 


If  t*  <  s  ,  then 
n 


r  (t*) 
n 


r>*) 


Therefore  r  (t*)  ±  r  (t*) 
n  n 


Define 


max 

min 

t*<vis 

n 

u<t* 

max 

min 

t*<vit 

u<t* 

v 


•s 


V/  /  \ 

rn(t) 


'„<C> 


V 

rn(t' 


t  *  s 


t  >  8 


t  f  S 


t  >  s 


Then,  on  (0,e],  r  (•)  +  r(-),  r  (•)  *  r(*)  a.s.,  and  the  r  (•) 

n  n  n 

are  uniformly  bounded.  It  follows  as  in  Lemma  5.3  that 

lim  i?  ,(?(■), n)  -  £(n  i  (r  ( •)  ,n)  -*•  0  a.s., 

L  w,e  J  n  (,u,e  j  n 


and  as  in  Lemma  3  that 


‘ho, 


e  j  (r(  •)  »n)  -  ^(0jC](r(-),n)j  > 


0  a.s. 


It  can  be  easily  shown,  as  in  the  proof  of  (5.1)  below,  that 
llm[Jf(0,cl<in(’)>n)  ‘  ■fi(0,c)(?n(-)>n)]  -°  a-s-- 


and,  since  rn(*)/r(‘)  is  bounded  below,  then 

u”[£'0,£]<V(-)-n)  -  •e(0,£](r(')'n)]  - 


0  a.s. 


Therefore, 


11"[fi(0,t]<"n(->'n)  ‘  £(0,E](r('),n)]  i0  a'S' 


Combining  these  limits,  we  obtain 


U“[JW/in(-,’n)  i0  *•' 


The  result  follows  if  we  can  show 
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lim  A£(n) 


UCO,c]<?n(-)-n)  -•e(0,c]<En(,)'n,)  * 


<£(0.c](r('),n)  "  •e(0,[!(r(’,'n)) 


i  0  a. s. 


Now,  by  definition 


A£(n) 


nFn(c) 


^  (In  r(xi) 


In  r(xi)) 


i  :x ,  <s 
i  n 


(/  rNndt  -  ?Nndt 'j  -  (jf  -  /  fNndtj  . 


As  mentioned  above,  (In  r  (t)  -  In  r  (t))  is  non-negative  on 
s  n  n 


f n 

(0,sn).  J  rN^dt  *s  a  sum  nFn(sn>  independent  exponential  random 

0  r  n 

variables,  and  therefore  is  a.s,  o(nF  (e)).  /  rN  dt  *  nF  (s  )  and 

n  "q  n  n  n 

therefore  is  o(nF  (e))  a.s.  Hence  lim  Al?(n)  i  0  a.s. 
n  n 

The  case  tfc  *  0  may  be  treated  similarly.  Instead  of  rn(*) 
we  consider  rn(*)»  t^ie  MLE  of  the  U-shaped  failure  rate,  with  turning 
point  s  . 


If  s  <  e,  r  (•)  is  more  likely  on  (e,“)  than  is  r  (•)»  and 
n  n  n 

the  proof  of  Theorem  5.1  proceeds  as  before. 


The  case  b  ■  ®  is  similar.  The  fact  that  we  must  consider  an 
infinite  interval  (N,»)  offers  no  difficulty  in  the  argument  of  Lemma 
5.3,  since  convergence  there  is  with  regard  to  the  finite  measure  F(*). 
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6,  Computer  Program 

A  computer  program  has  been  written  which  will  perform  the  operations 
described  in  earlier  sections  to  estimate  the  failure  rate,  the  probability 
distribution,  and  the  conditional  probability  of  failure  in  the  next  N 
units  of  time  where  N  is  an  input  parameter.  The  program  is  written 
in  the  FORTRAN  programming  language  and  is  broken  into  four  separate 
subroutines  as  follows  : 

1.  The  main  subroutine  which  controls  the  over-all  computation 

and  calculates  the  final  results.  A  user  need  call  only  this  subroutine 
and  provide  it  with  the  required  input  data. 

2.  A  subroutine  for  computing  the  total  exposure. 

3.  A  subroutine  for  adjusting  the  failure  rate  estimate  to  eliminate 
reversals . 

4.  A  subroutine  for  computing  the  likelihood. 

Each  subroutine  includes  comments  giving  the  names  oi  the  pertinent 
quantities  used  by  that  subroutine. 

Listings  of  the  subroutines  are  given  on  the  following  pages. 


nnnnnnnnnnnnnnnnnnn n  a  n 
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MLE  OF  DFK-IFH— SUiiWOUTlNE  FALRAT 

INPUT  REQUIRED  BY  SUBROUTINE  FALRAT 

13(11  ■  AGE  OF  UNIT  I  AT  BEGINNING  OF  OBSERVATION 
A ( 1 » J )  »  AGE  OF  UNIT  I  AT  ACTION  J 
E(I)  «  AGE  OF  UNIT  I  AT  END  OF  OBSERVATION 
NU  *  NUMBER  OF  UNITS 
NA(I)  ■  NUMBER  OF  ACTIONS  FOR  UNIT  I 

FAL 1  NT “CONDI T 1 ONAL  PROBABILITY  OF  FAILURE  INTERVAL  LENGTH 
KMAX  ■  LENGTH  OF  ARRAY  G( II 

OUTPUT  FROM  SUBROUTINE  FALRAT 

NT  A  *  TOTAL  NUMBER  Of  ACTIONS  ♦  1 
XIII  •  ORDERED  SET  OF  ACTIONS 

RH(  I  )  •  ESTIMATED  FAILURE  RATE  IN  INTERVAL  XU)-X(I-l) 

FML  -  LOGUIKLIHOOD  OF  RH<  ()  » 

FB (  I  )  *  MLE  OF  CAPITAL  F  BAR  IF  XU! 

K*NO.  OF  G ( I ) 

G( 11-PROBABILITY  OF  FAILURE  IN  NEXT  FALINT  INTERVAL 

SUBROUTINE  FALRAT < B , A»E»NU»NA »NTA#X *RH » FMLMX »FB »FALINT »K.KMAX*G) 

DIMENSION  B(l)iA(l)tEm*NA<l>*X(l)»RH(l> 

1.FB<1 )  .Gill 

DIMENSION  T(5000) »TI (5000) 

CALL  TOTtXP (B*A»E#NU*NAtNTA»X*T»TI| 

WR I TE ( 6 *2000 )(I»T(IJ»TI(I)»I«1»NTA) 

2000  FORMAT ( //4H 1  I  *  5X  » 1HT  • 10X»3Hl/T/( lX»I3i2XiF5*0»2X»Fll*8)I 
RM( 1 )-0. 

CALL  DFRIFR(T.TI »2»NTA»RH.1*NTA) 

CALL  L I KHOD( T*RH»NTA*1 tFMLMX  ) 

I  TPS* 1 
LM'NTA-2 
DO  20  I  TP*2  »LM 
I TPM*  I  TP-1 
I TPP* I TP+1 

CALL  DFRIFR(T»TI # 1 1 1  TPM .HH . 2 »NTA ) 

RH( I  TP ) 

CALL  DfRIFR(T»TI »ITPP#NTA»RM.1»NTA| 
call  LlKHOD(TtRH»NTA*ITP»FML J 
I F ( FML-FMLMX ) 20  *20# 10 
10  FMLMX-FML 
I  TPS* I  TP 
20  CONTINUE 
I TP*NTA-1 

CALL  0FRIFR(T#TI»1»NTA-2#RH»2»NTA) 

RHI I  TP  )  «0» 

RH(NTA)*1.0/T(NTA) 

CALL  LlKHOD(T»RH*NTA#|TP»FKU 
IF (FML-FMLMX)26#26»2* 

24  FMLMX*FML 


*-»  U  U  \J  \J  KJ 
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1TPS«I TP 

26  CALL  DFRIFR (T »T I .1*NTA-1»RH*2 »NTA) 
RH(NTA) «0. 

CALL  L  IKH0D(  T  ♦ RH »NT A *NT A t FKL I 
IF (FKL-FMLMX) 40*40*30 
30  FMLMX* FML 
GO  TO  00 

40  IF( 1TPS-1)60*50*60 
50  PH<  1  UO, 

CALL  0FRIFH(T#T1 .2*NTA*RH»1 iNTA) 

GO  TO  80 
60  I TPM=I TPS-1 
1 TPP* I TPS+1 

call  DFRIFR <T»T  I  *1.ITPM.KH»2.NTA) 

RH ( I  TPS  )  "0* 

call  DFRIFRIT*TI.ITPP»NTA,RM»1»NTA| 
IF ( ITPS-NTA+1 180.70*00 
70  RH(NTA)«1.0/T(NTA) 

DISTRIBUTION 

00  SM»X ( 1 )*  !H(  1  ) 

Ffi ( 1 ) «FXP (-SM | 

DO  90  I a2 .NT A 

smbsm+rhi  n*(x(  i  i-xu-ii) 

90  FBI  I ) «EXP ( -SM  ) 

CONDITIONAL  PROBABILITIES 
K  =  1 

FBT=1.0 
PR  ■  0* 

FAL=FAL1NT 

sm»o. 

100  IFIXIl )-FAL»140. 140*110 
110  SM«SM+RH( 1»*(FAL-PRJ 

FHTP=EXP(-SM ) 

G(K)  =  (H)T-F0TP|/FUT 
IF  (F-KI1AX)130*120»120 
120  STOP 
130  K=K+1 

FBTsFB  TP 
PR*FAL 

FAL  =  f  A|.  +FAL  I  NT 
GO  TO  100 

140  SM  =  SN+I.|  (1)  *  (  XI  1I-PRI 
PR«X( 1  ) 

DO  190  I =2  *NTA 
150  IFIXI  I  l-FAL ) 160*160*170 
160  SM*SM+RH( I ) *1 X( I )-PR) 

PR  =  X(  I  ) 

GO  TO  190 

170  SM*SM*RH ( I  I  * ( FAL-PR ) 

FbTP*tXP(-SM) 


GOO«(FBT-FBTP)/FBT 
IF (K-KMAX)lBOe 120*120 
1*0  K>K<*1 
FBT-FBTP 
PR-FAL 

fal«fal*falint 

GO. TO  150 
190  CONTINUE 
K-K-l 
RETURN 
END 


rinnnnnnnnnno 


* 
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ML£  OF  DFR-IFH— SUBROUTINE  TOTEXP( B»A»E»NU#NA#NTA»X»T#TI I 

Bd)  •  AGE  OF  UNIT  1  AT  BEGINNING  OF  OBSERVATION 

A ( I f  J )  -  AGE  OF  UNIT  I  AT  ACTION  J 

E ( II  ■  AGE  OF  UNIT  I  AT  END  OF  ubSERVAT ION 

NU  «  NUMBER  OF  UNITS 

NA ( I )  •  NUMBER  OF  ACTIONS  FOR  UNIT  I 

NT  A  ■  TOTAL  NUMBER  OF  ACTIONS  ♦  1 

X(I)  ■  ORDERED  SET  OF  ACTIONS 

TU)  ■  TOTAL  EXPOSURE  TIME  IN  INTERVAL  XlKI-XIK-ll 
T  I  (  X  I  «  1.0/T (X) 

SUBROUTINE  TOTEXP(B*A,E*NU»NA  *NTA.X*T»TI I 

DIMENSION  B(  U. E(l)  »NAI1I  »T(  1|  »Tim»X(  II 
DIMENSION  A ( 500*101 

X  «0 

DO  15  I « 1 » NU 
L  M  *  N  A  {  I  J 
I F ( LM I  15.15.5 
5  DO  10  J-l.LM 
X-K  +  l 

10  XlKI'AUiJ) 

15  CONTINUE 
NTArK+l 
FMX«0. 

DO  17  I  *  1 • NU 
I F I E ( I I-FMX 117*17*16 

16  FMX  =  E ( I  I 

17  CONTINUE 

X ( NT  A  J  =FMX 
CALL  SORT(X»NTA) 

X  *  1 

T<  1  )»0. 

DO  50  1=1. NU 
I F I B ( I  I -X  < 1 ) 120*50*50 
20  IF(E( I )-X( 1  I  I  10.A0.40 
30  T(  1  )*T  (  1  >  ♦  F  (  1  l-t3(  I  I 
GO  TO  50 

40  T ( 1  I =T ( 1 I+X ( 1  I-B ( I ) 

50  CONTINUE 

I F ( T U  )  152.52.54 
52  T  I(t  I -1 .0t>3  5 
GO  TO  56 

54  TI(1I«1.0/T(1) 

56  DO  160  K«2»NTA 
T ( X  I =0 • 

TINT=X ( X >-X ( K-l I 
DO  130  1=1. NU 
I F ( E ( I  I -X ( K - 1  I  ) 130*130*60 
60  IFIBd  I-XIK  H65.130.130 
65  IF(E( I I -X ( X  I 170*100*100 
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X00 

no 

120 

130 

140 

no 


!F<8(n-X|IC-l)J80.90#90 

TIK)«TU)4Em-Xnc-l) 

GO  TO  130 

T<K)«T<K)4>E(!I-BC!| 

GO  TO  130 


IF(BU»-X<IC-H|110. 110*120 

T(K)«T(K)+T|NT 

GO  TO  130 


T(K)"T(K)4X(K)-B(  I  I 
CONTINUE 

IF( T ( K  ) ) 140 » 140  *150 


TI (K)»1.0E+35 
GO  TO  160 
T I ( K ) «1 »0/T ( K  ) 


160  CONTINUE 
TI(NTA)*0« 
return 


END 
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MLt  OF  UFH-IFR— SUBROUTINE  DFRlFRIT.TI.ll.JF.RH.lD.NTA) 

T ( I >  -  TOTAL  exposure  time  in  interval  Xlll-XIl-ll 
TI  (  n  ■  1.0/TU) 

I  I  ■  INITIAL  INTERVAL  X ( I ) 

IF  -  FINAL  INTERVAL  X ( I  I 

RH(I>  ■  estimated  failure  rate  IN  INTERVAL  Xin-XII-lI 

ID  ■  1  FOR  INCREASING  FAILURE  RATE  ESTIMATE 
ID  •  2  FOR  DECREASING  FAILURE  RATE  ESTIMATE 
NT  A  *  TOTAL  NUMBER  OF  ACTIONS  ♦  1 

SUUROUTINE  DFR I FR ( T  » T I » I  1 t I F  »RH » ID »NTA ) 

DIMENSION  Till  .TI (1 J *RH(1) 

DC  10  I-I1.IF 
10  RH ( I  )  ■ T  1 1  I ) 

IF ( I  I-1FI30.20.20 
20  RETURN 
30  I  -  I  I 
LRL  *0 
40  K«I 
50  I - I ♦ 1 

GO  TO ( 60 »90 ) .ID 
60  IF(RH( 1)-RH(K|)100.70«?0 
70  IF( I-IF 140.80. «0 
60  IF ( LBL ) 30*20.30 
90  IF(RH(  I)-RH(Kn  70.70.100 
100  LBL* 1 
SUM*0. 

DO  110  J-K.I 
110  SUM*SUM-.T(J) 

FIK«I-K*1 

!F<  I -NTAU15. 112.112 
112  FIK-FIK-1 

115  RHJ=F I K/SUM 
DO  120  J*K.I 
120  RH(J)sRHJ 

I  F  (  I  —  I  r  ) ''0.00*80 
END 
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MLE  OF  DFR-IFR— SUBROUTINE  LlKHODI T»RH»NTA#ITP»FLK) 

T ( I  I  ■  TOTAL  EXPOSURE  TIME  IN  INTERVAL  Klil-XII-ll 
RHIII  ■  ESTIMATED  FAILURE  RATE  IN  INTERVAL  X(I)-XU-l) 
NTA  «  TOTAL  NUMBER  OF  ACTIONS  *  1 
I  TP  ■  INTERVAL  IN  WHICH  TURNING  POINT  IS  ASSUMED 
FLK  ■  LIKL1HOOD 

SUBROUTINE  L I KHOD < T »RH tNTA #  I  TP »FLlO 

DIMENSION  T ( 1 1 1 RH ( 1 ) 

FLK«0. 

LM-NTA-2 
DO  30  I "1 »LM 
IF ( I  —  I  TP ) 10*20*20 
10  FLK-FLK+ALOGIRHU) » -T  I  n»RH(  I  » 

GO  TO  30 

20  IF (RH(  I +1  ) ) 30 *  30 • 2 5 
2  5  FLK*FLX+ALOG(RHI  141JI-RHI  l4l)*T( 1*1) 

30  CONTINUE 

FLK«FLK-T(NTA|*RH(NTAJ 

RETURN 

END 
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